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ABSTRACT 



This report on the short-term effects of Upward Bound, a 
federal pre-college program designed to help economically disadvantaged 
students complete high school and gain access to post- secondary education, 
presents interim findings from the Longitudinal Effectiveness Study of Upward 
Bound based on data on approximately 2,800 students during the first year or 
two of high school. At present, there are more than 600 Upward Bound 
projects; they offer intensive instructional programs and are usually hosted 
by 2 -year and 4 -year colleges. The study found that: (1) Upward Bound has 

early positive impacts on students’ educational expectations and academic 
course-taking; (2) students with lower educational expectations initially 
benefit more from Upward Bound; (3) Hispanic students initially benefit most 
from Upward Bound; and (4) many students (about 37 percent) who enter Upward 
Bound leave the program during the first year. After an executive summary and 
introductory chapter, Chapter 2 presents data on persistence in Upward Bound, 
and on the Upward Bound services offered. Chapter 3 details short-term 
impacts of Upward Bound, including the average impact of the program and 
groups benefitting most. The concluding chapter summarizes findings, compares 
them to previous findings, and draws implications for program improvement. 
Eight appendices provide additional detail on research methodology, data 
interpretation, and statistics. (Contains 18 references.) (DB) 
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EXECUTIVE SUMMARY 



Upward Bound, which was initiated in 1965 as part of the War on Poverty, is a federal 
precollege program designed to help economically disadvantaged students complete high school and 
gain access to postsecondary education. Besides federal student-aid programs for college students, 
Upward Bound represents the largest federal intervention that helps students attain a postsecondary 
education. At present, there are more than 600 Upward Bound projects serving 42,000 students. 
Federal requirements mandate that at least two-thirds of each project’s participants must be from 
households that have low income (less than 150 percent of the poverty threshold) and where neither 
parent has graduated from college; up to one-third of the participants can be from either low-income 
or first-generation college families. 1 Upward Bound projects offer intensive instructional programs 
that also include tutoring and counseling services. Students meet throughout the academic year with 
Upward Bound staff and generally participate in an intensive summer program that lasts about five 
to eight weeks. Most students enter the program for the first time while in 9th or 10th grade and 
some students remain with Upward Bound through 12th grade. Upward Bound projects are usually 
hosted by a two- or four-year college. Some Upward Bound projects are hosted by community-based 
organizations and high schools. In 1996, the annual average cost per participant was about $3, 800. 2 

This report contains findings from the Longitudinal Effectiveness Study of Upward Bound 
conducted by Mathematica Policy Research, Inc. (MPR) and its subcontractors, Westat and Decision 
Information Resources, under contract to the U.S. Department of Education (ED), Planning and 
Evaluation Service. This represents the first large-scale evaluation of the Upward Bound program 
since Research Triangle Institute’s evaluation nearly twenty years ago. 

Based on data for more than 2,800 students, this report describes the short-term impact of 
Upward Bound on students during the first year or two of high school. A second report, using data 
drawn from a survey of students that will be completed in late 1997, will describe the program’s 
impact on outcomes such as high school graduation and college enrollment and persistence. The 
research questions addressed in this report include: 

• How long do participants stay in the program? How many participants drop out of 
Upward Bound, and what are their reasons for leaving the program? What kinds of 
services do participants receive from Upward Bound projects? 



'We find that 80 percent of new applicants are from both low-income and first-generation college 
families, almost a fifth are from first-generation families only, and less than 5 percent are from low- 
income families only. 

2 A detailed description of Upward Bound projects can be found in Fasciano and Jacobson (1995) 
and a description of Upward Bound Target Schools can be found in Waldman et al. (1995). An 
overview of Upward Bound that draws on numerous sources can be found in Moore (1997). 
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• What is the impact of Upward Bound on students’ education-related outcomes? Do 
some students benefit more than others from participation in Upward Bound? 



About the Longitudinal Effectiveness Study 

The longitudinal effectiveness study is part of a comprehensive five-year evaluation of Upward 
Bound projects, target schools, and students being conducted by MPR and its subcontractors. The 
study focuses on regular Upward Bound projects, which means it excludes projects that serve 
veterans or those that received special grants to emphasize a math/science curriculum. In addition 
to the longitudinal effectiveness study, the national evaluation includes a survey of nearly 250 Upward 
Bound project directors, detailed field visits of 20 Upward Bound projects, and a survey of more than 
700 Upward Bound target schools. 

The findings in this report are based on several sources of data. First, as Upward Bound projects 
recruited students to fill program slots during 1 992-94, eligible applicants were asked to complete 
a baseline questionnaire that asked about their family background, attitudes and expectations, and 
school experiences. Second, during the spring and early summer of 1 994, we asked these applicants 
to complete a follow-up survey so that we could update their school-related experiences, attitudes, 
and expectations. More than 97 percent of the program applicants responded to the survey. In 
addition to the survey data, we used data obtained from high school transcripts collected after the 
1994 academic year, and reports of students’ participation in Upward Bound services that were 
recorded by Upward Bound project staff. Students were surveyed again in summer 1996 and the 
study team collected students’ high school and postsecondary transcripts after the 1996 school year. 
This last round of data collection provided a more complete picture of students’ high school 
experiences, academic preparation, college plans, and for some students, college enrollment and 
persistence. 

To assess program impacts, the evaluation selected a nationally representative sample of 67 
Upward Bound projects hosted by two- and four-year colleges. Eligible applicants in the 67 Upward 
Bound projects during 1992-94 were randomly assigned to Upward Bound or a control group. The 
Upward Bound group included 1,524 students and the control group included 1,320 students. Short- 
term impacts were estimated by comparing students in the two groups on a range of measures 
including high school performance (for example, grades and course taking), attitudes and 
expectations, and parental involvement. Using the randomized experimental design along with a 
nationally representative sample of Upward Bound projects yields program impacts that have both 
internal and external validity; that is, the design allows us to isolate the impact of Upward Bound on 
student outcomes and to generalize the findings to all Upward Bound projects hosted by two- and 
four-year colleges. 



Major Findings 

The findings contained in this report focus on two related issues. (1) the short-term impact of 
Upward Bound on students’ education-related outcomes and course taking, and (2) students’ 
persistence in the Upward Bound program. 
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Upward Bound Has Early Positive Impacts on Students’ Educational Expectations and 
Academic Course Taking 

Educational Expectations 

Evidence obtained from students about the number of years of schooling they plan to complete 
shows that, on average, Upward Bound participants expected to complete almost .25 more years of 
school than did members of the control group. Both Upward Bound participants and students in the 
control group typically experienced a decline in expectations between the time of application and the 
follow-up survey; however, the decline was larger for the control group. This finding suggests that 
involvement in the program was more likely to reinforce participants’ high expectations, while no 
involvement allowed the control group’s expectations to erode between the time of application and 
the follow-up survey. 

Upward Bound also had a positive impact on parents’ educational expectations as reported by 
students: parents of Upward Bound participants expected their children to complete about .3 more 
years of schooling than did the parents of children in the control group. Little change was observed 
in the expectations of participants’ parents; however, relatively large declines in expectations were 
observed for parents of children in the control group. 

Course Credits 

Besides having a positive impact on educational expectations. Upward Bound increased the 
number of credits students earned during the first few years of high school: program participants 
earned about 1 credit (Carnegie unit) more than nonparticipants. This overall impact of 1 credit stems 
from participants earning substantially more credits in science, math, English, foreign languages, and 
social studies. Participants also earned more credits than nonparticipants in vocational education 
courses and in remedial math courses. When these impacts are compared with the experiences of a 
typical high school student who each year is expected to complete about five academic and/or elective 
credits, they appear quite large. 



Students with Lower Educational Expectations Initially Benefit More from Upward Bound 

Educational Expectations 

Although almost three-quarters of the eligible applicants expected to complete at least a four- 
year college degree before entering the program, students who benefitted most from participating in 
Upward Bound were those with lower expectations (that is, students who did not expect to complete 
a four-year college degree ) Upward Bound increased parents’ educational expectations to a greater 
degree when students started Upward Bound with low expectations. Upward Bound increased 
fathers’ expectations by 1 .2 years for participants who did not expect to complete four years of 
college. Neither fathers’ nor mothers’ expectations for participants who held higher expectations 
changed and no difference was observed for changes in students’ own expectations regardless of their 
initial plans. 
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Course Credits 



In terms of outcomes related to academic preparation, Upward Bound had larger positive 
impacts on credits earned in math, English, and social studies for students with lower expectations. 
These students gained almost .6 more math credits than members of the control group; the 
corresponding figure for students with higher expectations is . 1 credit. In addition, participation in 
Upward Bound led to an increase of about .8 credits in English and social studies for students with 
lower expectations. Across all academic subjects, Upward Bound increased the number of credits 
earned by 3.1 for participants with lower expectations and by .5 credits for those with higher 
expectations. 



Hispanic Students Initially Benefit Most from Upward Bound 

Among the three largest race/ethnic groups in Upward Bound, a consistent picture of program 
impacts on course taking emerged: Hispanic students routinely experienced larger returns from 
participating in Upward Bound than either African American or white participants. Hispanic students 
gained more than two credits, while African American and white students in Upward Bound gained 
less than .5 credits. Higher returns to participating in Upward Bound for Hispanics are obvious in 
several subjects: math, English, foreign languages, social studies, and vocational education. 



Many Students Who Enter Upward Bound Leave the Program During the First Year 

While the short-term impacts suggest that Upward Bound has a substantial effect on educational 
expectations and course taking, the effect may have been even larger if more students stayed in the 
program. Even in the first year, participants who leave Upward Bound early, for example, do not 
earn as many credits in high school as those who remain. Despite the value of staying, many students 
do choose to leave Upward Bound in the first year. Projections based on the experience of all 
students in the study suggest that 37 percent of those who participated will leave within the first 12 
months. This program dropout rate is very likely to increase at the close of the junior year— when 
project staff say that students are most likely to leave the program for jobs. All told, attrition from 
Upward Bound may be quite substantial by the time students finish high school. 
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I. INTRODUCTION 



Upward Bound, along with Head Start and Job Corps, was the War on Poverty's major response 
to the dismal educational opportunities faced by many low-income students. The goal of this program 
is to provide supplemental academic and support services to students from disadvantaged 
backgrounds in order to help them finish high school, gain admission to college, and successfully 
complete a degree program. Since its first year of full funding in 1966, the program has more than 
doubled in size, now serving 42,000 students per year. 

In December 1991, the US. Department of Education funded a five-year longitudinal evaluation 
of Upward Bound. The objectives of the evaluation include documenting how Upward Bound 
projects deliver services to program participants, the kinds of services offered, the role of target 
schools in the Upward Bound program, and the impact of Upward Bound on participants’ education- 
related outcomes. This report presents estimates of the short-term impacts of the program, based on 
data collected during the period 1992-94. These data allow us to assess the short-term impacts of 
the program. A final report to be submitted to the US. Department of Education in late 1997 will 
describe the longer term impacts of Upward Bound. 

This introductory chapter reviews the program and policy background for the study, and 
describes the policy context and design. Chapter II examines students' persistence in Upward Bound, 
the reasons students report for leaving the program, and the range and intensity of the services they 
receive. Chapter III presents estimates of the short-term impact of Upward Bound on students' 
education-related outcomes, including educational expectations, attitudes, academic preparation and 
grades, behavior in school, and parents' involvement in school-related activities. 
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A. PROGRAM AND POLICY BACKGROUND 



Upward Bound projects offer intensive academic, tutoring, and counseling services to youth who 
are between 13 and 19 years old and in grades 9 to 12. Two-thirds of the Upward Bound participants 
in each project must be potential first-generation college students whose families have incomes at or 
below 150 percent of the poverty threshold; the remainder must meet either the low-income or the 
first-generation requirement. Projects are required to provide five to eight weeks of services to 
students each summer and to reinforce the summer experience with at least weekly services during 
the school year. The summer component is usually designed to simulate a college experience and 
often involves full-time residence on a college campus. During the academic year, participants can 
meet with counselors and instructors after school or on weekends. Estimates of the cost of these 
services show that the per-pupil cost in 1996 was $3, 800. 1,2 At present, there are more than 500 
regular Upward Bound projects, each serving 50 to 150 students with an average of 90. About 68 
percent of the projects in 1995 were hosted by four-year colleges, 28 percent were hosted by two- 
year colleges, and 4 percent were hosted by community-based organizations and high schools. 

The need for programs such as Upward Bound seems as apparent today as it was more than 25 
years ago. In the mid-1960s, Coleman and others documented the poor academic preparation and 
low educational attainment of economically disadvantaged youth (see, for example, Coleman et al. 
1966, Jencks et al. 1972, Mosteller and Moynihan 1972). Since the call to arms in A Nation at Risk 
(National Commission on Excellence in Education 1983), the nation’s schools and educators have 
attempted to rectify this situation and improve the academic preparation of all students. However, 



'SeeFasciano and Jacobson (1995) and Moore (1997) for a comprehensive description of Upward 
Bound grantees. 

2 In contrast to the intensive and costly services provided through Upward Bound, the federal 
Talent Search program spends $230 dollars per student, and the federal Student Support Services 
program’s per student cost is $800. 
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after more than a decade, we still find a large gap in academic performance between students from 
economically disadvantaged and advantaged families. Recent analyses published by the National 
Center for Education Statistics suggest, for example, that for the past 20 years, the gap in reading and 
math achievement between students from families with high and low socioeconomic status (SES) has 
remained large or may have increased (Green et al. 1995). Data from the National Assessment of 
Educational Progress suggests a slight narrowing of the achievement gap for whites and blacks, but 
a substantial gap still persists (NAEP 1994). Although enrollment in vocational and general high 
school tracks has become less common among low-SES students, almost three-quarters of these 
students still report participating in one of these noncollege preparatory tracks (Green et al. 1995). 
During the same period there was a small increase in the proportion of high-SES students in these 
programs; only one-third of the high-SES students participate in a nonacademic high school program. 
Statistics on college-going behavior suggest some improvement for low-income students enrolling 
in postsecondary schools, but there remains a large gap between these students and their high-income 
counterparts. For example, there is a full 30 percentage point difference between high school 
graduates from low-income families enrolling in college and high-income students who go to college 
(Mortenson 1995). Statistics from the mid-1980s also show that if the gap in academic achievement 
were closed for blacks and whites, both groups would have similar college enrollment patterns (Myers 
1987). 3 



3 When estimating the effect of achievement on the college attendance gap, Myers used statistical 
adjustments to hold constant other background variables including family income and mother’s 
educational attainment. 
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B. STUDENTS RECEIVING UPWARD BOUND SERVICES 



As we already noted, Upward Bound participants must be from either low-income families or 
families where neither parent completed a four-year college degree. 4 Comparing Upward Bound 
applicants during the 1 992-94 period with other students from similar grades and from families with 
low socioeconomic status shows that Upward Bound applicants have higher educational attainment 
expectations, are better prepared academically, and have parents who are generally more involved 
in their children’s school-related activities. 5 Upward Bound applicants are also disproportionately 
made up of young women and African American students. 



• Educational expectations. Upward Bound applicants have higher educational 
expectations than other high school students and students from families with low 
socioeconomic status (SES). 6 Three-quarters of Upward Bound applicants report that 
they expect to complete at least a four-year college degree, while three-fifths of all 
students and about one-third of low-SES students report similar expectations. 

• Course taking and grades. Upward Bound applicants have better academic 
preparation than other low-SES students. About 40 percent of all applicants had 
completed at least one geometry course before entering Upward Bound. Looking at all 
students in the same grades we find similar results; however, low-SES students are less 
likely to have taken geometry at the same point in school (27 percent). About 25 
percent of applicants had completed two or more foreign language courses before 
entering Upward Bound. In contrast, 17 percent of low SES students had completed 
two or more courses. About 45 percent of the applicants have a 9th-grade GPA below 



“An overview of the characteristics of Upward Bound applicants is shown in Technical Appendix 



5 The comparison is based on students who participated in the 1988 National Educational 
Longitudinal Survey of Eighth Graders (Ingels et al. 1994). 

6 Students with low socioeconomic status (SES) are in the lower third of the SES distribution. SES 
is defined in terms of family income and parents’ education and occupation. The items are weighted 
and then summed to form Duncan’s Socioeconomic Index. The weights are described in Nakao and 
Treas (1992). 
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a C; about 37 percent have a GPA of a C or B 7 The average 9th-grade GPA for all 
applicants is 2.4 (C+). 

• High school graduation requirements. Many Upward Bound applicants are meeting 
academic course requirements before entering Upward Bound. On average, states 
require students to complete about 13 course credits in English, social studies, foreign 
languages, math, and science before they can graduate from high school. This means 
that over a four-year period students should complete about three courses from these 
subject areas each year. Among applicants who are in grades 10 or above when 
entering Upward Bound, we find that 50 percent completed at least three courses in 
these subject areas in 9th grade and 75 percent completed two or more courses. 

• Parental involvement. Parents of Upward Bound applicants have higher levels of 
involvement in their children’s activities than other parents. More than 40 percent of 
the applicants report that their parents often check their homework compared to 22 
percent of all low-SES students who report that their parents often check their 
homework. About 26 percent of all students in the same grades as the Upward Bound 
applicants report their parents often check their work. 

• Background characteristics. Compared with high school seniors, Upward Bound 
applicants are disproportionately female (70 percent) and African American (53 
percent); about 20 percent are white, another 20 percent are Hispanic, and about 7 
percent are Asian or Native American. In comparison, about 50 percent of all high 
school seniors in 1992 were boys, 12 percent were African American, 73 percent were 
white, almost 5 percent were Asian, and 10 percent were Hispanic. 8 



C. THE RESEARCH CONTEXT 

The Upward Bound program has been the subject of many evaluations sponsored by the U S. 
Department of Education and its predecessor, the US. Office of Education. Many of these studies, 
however, relied on student records from national surveys or administrative records maintained by the 
Upward Bound program, or they focused on a single Upward Bound project. Only one 
comprehensive evaluation of Upward Bound’s effectiveness has been completed since the program's 
inception in 1966. Conducted by the Research Triangle Institute (RTI) between 1973 and 1979, the 



7 We have not been able to identify comparable, published data for all students or other low-SES 
students in similar grades. 



8 We have not been able to identify similar published data for students from low SES families. 
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study examined project characteristics and evaluated the effectiveness of Upward Bound for a range 
of outcomes, including academic preparation and college enrollment and retention (Burkheimer et 
al. 1979). 9 RTI's basic conclusions about the effectiveness of Upward Bound included the following: 

• Upward Bound does not affect students' high school academic preparation or grades. 

• Upward Bound has a positive effect on college enrollment. 

• Upward Bound has positive effects on overall educational attainment, but no effect on 
students’ persistence in college. 

The current evaluation conducted by Mathematica Policy Research (MPR) and its 
subcontractors, Westat, the Educational Testing Service, Public and Private Ventures, and DRI Inc., 
presents findings from the national evaluation of Upward Bound's longitudinal impact study. 
Students included in the study applied for Upward Bound during the 1992-93 and 1993-94 school 
years during which period we collected baseline data. The first round of follow-up data collection 
occurred in the summer of 1994, gathering information about students' educational experiences, 
course-taking patterns and grades, attitudes and expectations, and participation in the Upward Bound 
program. This first follow-up data collection forms the basis of the findings reported here. Another 
round of data collection, conducted in 1996 and 1997, will serve as the basis for a detailed assessment 
of the impact of Upward Bound on students' high school experiences and early college-going 
behavior. 

The following research questions are addressed in this report: 



9 RTI’s approach for examining the effects of Upward Bound focused, on a comparison group 
methodology. Using this method they attempted to identify students from Upward Bound target 
schools who were similar to participants. While they were able to remove some differences, they 
found, for example, that members of the comparison group had lower educational expectations than 
Upward Bound participants. Differences such as this between the Upward Bound sample and the 
comparison group sample can lead to erroneous conclusions. 
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• How long do participants stay in the program? How many participants drop out of 
Upward Bound, and what are their reasons for leaving the program? 

• What kinds of services do participants receive from Upward Bound projects? 

• What is the average impact of Upward Bound on students' education outcomes? Do 
some students benefit more than others from participation in Upward Bound? 

We also examined whether some project characteristics were associated with differences in 
persistence and project-specific impacts. Analyses showed that while there was substantial variation 
among projects for students’ persistence in Upward Bound and several education-related outcomes, 
no clear patterns of associations with project characteristics were discovered. Technical Appendix 
H shows the distribution of project impacts for selected outcomes. 

D. RESEARCH DESIGN 

The results described here are based on the first rigorous evaluation of the Upward Bound 
program in the last 20 years. The research design uses a nationally representative sample of Upward 
Bound projects and random assignment selection procedures for constructing two statistically 
equivalent groups of students: a treatment group selected for Upward Bound and a control group. 
By using a probability sample of projects and random assignment of students to a treatment and 
control group, this design provides both strong external and internal validity. We can answer the 
following general question: On average, how do the educational experiences of Upward Bound 
applicants and participants compare to what they would have achieved in the absence of Upward 
Bound ? By analyzing impacts for all students randomly selected for Upward Bound, we can estimate 
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impacts for applicants. By taking into account how many students showed up once offered a program 
slot, we can estimate impacts for participants. 10 

From the list of regular Upward Bound projects, we selected 70 projects for the impact study." 
Eleven of the projects were not able to participate in the study for a variety of reasons. Some were 
defunded by the U S. Department of Education during the 1991-92 grants competition. Others did 
not expect to recruit new students for the 1992-93 school year, or had too few applicants to construct 
a control group or to fill all funded program slots. We replaced with a randomly selected similar 
project all but three of the projects that could not participate. The final sample for the longitudinal 
impact study includes 67 Upward Bound projects. 

To assess program impacts, we constructed treatment and control groups from students selected 
at random from the pool of eligible applicants during the 1992-93 and 1993-94 school years. Eligible 
applicants were defined as students whom projects recruited and who met both federal requirements 
and project specific criteria for participation. The treatment group includes 1,481 students, and the 
control group, 1,266 students. Students in each project were given the same chance of being 



10 Before we randomly selected students for Upward Bound and the control group, we asked 
project directors to rate applicants as most likely to be selected, somewhat likely to be selected, and 
least likely to be selected under normal selection rules. Looking at these three groups of students we 
discovered few differences in their observable characteristics and few differences in who benefitted 
most from the Upward Bound program. These findings suggest that random selection of students 
meeting both the federal criteria and minimum project-specific standards did not substantively alter 
the kinds of students projects normally serve. 

"The sample represents Upward Bound projects that are (1) in the 50 states or the District of 
Columbia; (2) hosted by a postsecondary institution; (3) mature, having operated for at least three 
years by October 1992; and (4) not dedicated to serving only students with physical disabilities. 
Eliminated from the sample were new projects, projects hosted by high schools or community-based 
organizations, projects in the territories, and projects that serve exclusively disabled students. The 
70 projects in the impact study also participated in a survey of Upward Bound project directors (for 
a description of this survey, see Fasciano and Jacobson 1995). 
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selected for Upward Bound. 12 All projects served the same number of students they would usually 
serve when normal selection procedures were used. Implementing random assignment in the 67 
projects took about 14 months. We used this long build-up period so that projects could use their 
normal recruiting procedures and enroll students following their regular enrollment schedules. 
Procedures for drawing the sample and constructing sample weights are described in Technical 
Appendix A. 

The random assignment design allows us to construct estimates of program impacts that are free 
of selection biases that have plagued other attempts at assessing the effectiveness of Upward Bound. 13 
The only difference between the Upward Bound group and the control group is the availability of 
Upward Bound services. 14 The groups are otherwise statistically equivalent. Using the treatment and 
control groups, we computed two estimates of program impact for each outcome. The first estimate 
refers to the impact of Upward Bound for all students selected for the treatment and the control 
group. Thus, the treatment group includes both students who chose to participate once offered a slot 
and those who did not. The second estimate corresponds to the program’s impact on participants 
and adjusts for the fact that some students offered openings declined to participate. Our approach 
for making adjustments for nonparticipants is described in Technical Appendix C. 



12 In many cases, projects requested that we maintain a specific mix of boys and girls or select 
predefined numbers of students from each of their target schools. To accommodate this request, we 
used a stratified random sampling scheme to ensure the project composition met their requirements. 

* 13 A detailed statement of the random assignment procedures is presented in Myers et al. (1 993) 

and a comparison of the Upward Bound and control groups at the time of application (and before 
random assignment) is presented in Technical Appendix B. 

I4 Upward Bound project directors provided services to 29 students selected for the control group. 
While we allowed these students to continue to receive Upward Bound services, for purposes of the 
analysis we maintained their original status as members of the control group. By maintaining their 
status, we obtained a trivially small underestimate of the program’s impact. To treat these students 
as members of Upward Bound or to remove them from the analysis sample would violate the random 
assignment procedures and reduce the study’s internal validity. 



ERIC 



9 



23 



Data were collected during two periods. First, we collected information from students using a 
selfassessment completed when they applied to the program (baseline data collection). Second, we 
collected data from students through a telephone survey in the spring of 1994. For the baseline data 
collection, we achieved almost a 100 percent response rate, and for the follow-up survey, we 
achieved a response rate of more than 97 percent. In addition to obtaining information from students, 
we collected student transcripts that include detailed information on course taking and grades, and 
we asked Upward Bound project directors to report on the range and intensity of services received 
by students in the sample. We also supplemented the student data with survey data collected from 
Upward Bound grantees and the target schools attended by students in our sample. 
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II. PERSISTENCE IN UPWARD BOUND AND UPWARD BOUND SERVICES 



Applicants may take one of several paths after applying for Upward Bound. Some applicants will 
not be selected by a project because they do not meet project specific criteria, such as grade point 
average, or because they have disciplinary problems (Fasciano and Jacobson 1995). Other applicants 
may choose to pursue another program, take a job, or participate in sports. Over 14 months we 
selected 1,481 students for Upward Bound. This chapter draws on data extracted from administrative 
records reported by Upward Bound project directors and their staff and data from the first follow-up 
survey of students to document some of the experiences of these youth In analyzing the data, we 
examined the number of applicants who participated in Upward Bound, the number who persisted, 
and the duration of their involvement in the program. We also explored the reasons students gave for 
not participating, and we examined the services students received from Upward Bound. 



A. PARTICIPATING IN UPWARD BOUND 



• Twenty percent of the eligible applicants MPR randomly selected for Upward Bound 
did not participate when offered a program slot. This no-show rate does not appear to 
be a product of random selection including students in the program who had higher 
than normal no-show rates; instead, it reflects the typical experiences of students 
selected for Upward Bound. 

• Some of the reasons given for not participating included taking a job, transportation 
problems, and family issues. 

• Hispanic and Asian students are more likely to participate after being selected than 
African American students. Younger students are more likely to participate than are 
older students. 



About 20 percent of the students we randomly selected for Upward Bound did not participate; 
that is, they did not accept an offer to enter Upward Bound.' During the first follow-up survey, we 
asked the nonparticipants to list the reasons behind their decisions. Some reasons included taking a 
job, transportation problems, family issues, time conflicts, and the program not contacting them. The 
percentage of applicants reporting each of these reasons is shown in Table H 1 . None of the reasons 
stands out as the dominant justification for not participating and none is frequently given. 



TABLE H I 

PERCENTAGE OF NONPARTICIPANTS, BY REASON 
CITED FOR NOT ATTENDING 



Reason 


Percentage of Nonparticipants a 


Took a job 


15 


Transportation problems 


14 


Program did not contact student 


16 


Family issues 


11 


Time conflict 


13 



“Students could give multiple responses if necessary and percentages do not sum to 100. 



'We assessed whether nonparticipation was related to the random selection process and projects 
working with students they might not normally choose. Before we assigned students to Upward 
Bound and the control group, we asked project directors to rate students as most likely to be selected, 
somewhat likely to be selected, and less likely to be selected when using normal selection rules. The 
nonparticipation rates for these three groups are not significantly different. This suggests that even 
in the absence of the evaluation, about 20 percent of those selected for Upward Bound will choose not 
to participate. 
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In addition to looking at the reasons for not participating, we also examined whether specific 
background characteristics were associated with students' decisions. The factors we examined include 
sex, race/ethnicity, grade level, low income/first generation status, working for pay during the previous 
summer, students’ educational plans at the time of selection, and project directors’ ratings of students’ 
likelihood of being selected for Upward Bound under normal selection rules (see Technical Appendix 
D for participation rates for selected groups of students). We explored the correlates of participating 
in Upward Bound by examining the odds (chances) of entering the program while statistically 
adjusting for differences on other student and family background variables (see Table n . 2). 2 An odds 
ratio of less (greater) than 1 shows that one group of students is less (more) likely to participate than 
the reference group, net of the other factors. Only two factors have an independent effect on the 
chances of participating in Upward Bound: (1) race/ethnicity and (2) and students’ grade level. Both 
Asian and Hispanic applicants were more likely to participate in Upward Bound than African 
American students, and students recruited in later grades were less likely to participate than those 
recruited earlier. None of the other factors affects participation. 

B. PERSISTENCE IN UPWARD BOUND 



• Almost 40 percent of new Upward Bound participants drop out of the program within 
1 2 months. 

• The most common reason participants drop out of Upward Bound is to take a job. 

• Asian and Native American participants persist at a greater rate than African American 
students. Participants planning to complete college are more likely to remain in 
Upward Bound than are other participants. 



2 The independent effects of the characteristics are obtained from a binary logit model. Standard 
errors were computed taking into account the complex sample design. 
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TABLE H.2 



ADJUSTED ODDS OF PARTICIPATING IN UPWARD BOUND 



Background Factor 


Adjusted Odds Ratio 


Female 3 


.81 


Hispanic b 


3.85** 


Asian b 


5.03** 


White b 


1.74 


Native American 1 ” 


1.18 


Other race b 


.65 


Grade level 0 


72 ** 


Low income/first generation d 


1.41 


Upward Bound project director’s rating 


.87 


Worked for pay during summer 


.84 


Plans to complete at least a college degree 


1.14 



Note: Participants are defined as students who were selected for Upward Bound and started the 
program. 

^Statistically significant at the .05 level. 

“Reference group is male. 
b Reference group is African American. 

“Grade level coded as grade completed the year before applying for Upward Bound (8, 9, 10, 11). 
d Reference group is low income only and first generation only. 
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We asked Upward Bound project directors after the 1994 summer program to report when 
students started participating in Upward Bound, whether they were still in the program, and, if 
participants left Upward Bound, when they last attended. Using this information, we developed a 
profile of the chances of Upward Bound participants leaving the program monthly (see Figure 13. 1). 3 
Figure HI shows the potential experiences for a group of new Upward Bound participants. 4 The 
figure shows that about 63 percent of participants will remain with the program after the first 12 
months, and 37 percent will leave. To see the implications of this, imagine a typical Upward Bound 
project with 25 new participants— students who decided to participate after being offered an opening 
by an Upward Bound project. After 1 2 months, 9 participants will have left the program, and 1 6 will 
remain. 5 We can also project this experience for all Upward Bound projects in the nation. Based on 
the number of students selected for Upward Bound as part of the evaluation, we estimate that 
nationwide, 17,700 students will enter each year. From among this group, more than 6,500 will leave 
Upward Bound in the first 12 months, leaving about 1 1,000 from the initial group. While we cannot 



3 The analysis of program persistence focuses on the experiences of participants-students who 
showed up for services— and not all students selected for Upward Bound as part of the random 
selection research design. Estimates presented in Figure ELI are derived from a hazards model and 
take into account that not all participants had similar start dates. The confidence intervals are shown 
so that the reader can assess the precision of the estimates. They show, for example, that the estimated 
probability of persisting for 12 months is measured with less precision than the probability of 
persisting for six months. The loss of precision arises because fewer students had an opportunity to 
participate in Upward Bound for 12 months than six months— a function of the projects using different 
start dates. 

4 Besides looking at the overall persistence of students in Upward Bound, we also examined the 
variability in persistence among projects. This analysis showed that while there are considerable 
differences in persistence among projects, few if any project characteristics were associated with 
persistence. Some factors we examined included predominant race/ethnicity, size, urban location, 
type of host institution, and curricular emphasis. 

5 If we include the no-show rate in the computation, then almost half of those selected for Upward 
Bound will have dropped out within 1 2 months. For example, starting with 25 students selected for 
Upward Bound we would expect that only 20 will accept a program opening, and only 1 3 of the initial 
group will still be participating after 12 months. 
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FIGURE II. 1 

PROBABILITY OF REMAINING IN UPWARD BOUND, BY MONTH 
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directly assess whether all of these students are replaced, anecdotal evidence and data from the grantee 
survey suggest that many are. For example, when talking with project directors we learned that 
projects often maintain a waiting list. Also, the grantee survey data show that about two-thirds of the 
projects admit new students during both the academic and summer sessions, suggesting that program 
openings are routinely filled (Fasciano and Jacobson, 1995). 

Some reasons that students cited for leaving Upward Bound include their family moving away 
from the project of time conflicts, but the primary consideration for students is a job (see Table H.3). 
Looking at the reasons both for leaving Upward Bound and for not participating (Table H 1 ), it appears 
that employment was an important consideration for these generally low-income students. The finding 
on the employment/persistence relationship also coincides with reports from Upward Bound project 
directors who said that students typically drop out of Upward Bound to take a job during the summer 
or academic year (Fasciano and Jacobson 1995). 

While employment appears to be important for Upward Bound participants, few participate in Job 
Training Partnership Act (JTPA) or work-study programs offered through Upward Bound projects. 
Data collected from project directors about students’ Upward Bound activities suggest that only about 
four percent of the students participate in a work experience program associated with the Upward 
Bound project during the summer and less than one percent participate in one of these programs 
during the school year. 6 The relationship between employment and participation and/or persistence 
and the limited work-related experiences acquired by participants suggests that one strategy for 
retaining students may be to expand job opportunities through the program. In part, this is supported 



6 In part, this reflects that many of the students are too young to work. Linking the grantee survey 
data and the student data shows that about 50 percent of Upward Bound participants during the 1993 
summer session were enrolled in a project that offered some kind of work experience such as JTPA. 
Among those who participated in the 1993-94 academic year only 8 percent were enrolled in projects 
that offered some kind of work experience activity. 
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TABLE H.3 



PERCENTAGE OF STUDENTS LEAVING UPWARD BOUND, 
BY REASON CITED 



Reason 


Percentage of Students 3 


Took a job 


31 


Family moved 


14 


Time conflict 


11 


Asked to leave the program 


10 


Grades low 


9 


Family issues 


7 


Pregnancy 


6 



Tercentages do not sum to 1 00 because students were allowed to provide multiple responses. 



by the survey of Upward Bound project directors. Fasciano and Jacobson (1995) showed that program 
retention was higher in projects offering year-round work experience than in those with less than an 
all-year program. 

In addition to the reasons for leaving Upward Bound, we looked at the role of family background 
characteristics in predicting persistence. As in the analysis of participation, we discovered that few 
student background factors have an independent effect on students’ persistence. To assess the effect 
of student and family background factors on persistence, we used an analytic model that predicted the 
monthly rate of leaving the program. 7 From the model we can learn how the relative chances of 
leaving Upward Bound are influenced by family background factors. Two factors stand out as 
predictors of persistence: (1) students’ race/ethnicity and (2) students’ educational plans. Students 

7 Model estimates were derived from a proportional hazards model, and standard errors were 
computed taking into account the complex sample design. 



planning to complete less than a college degree were more likely to leave Upward Bound than other 
students. We also found that Asian students were about one-third as likely to leave as African 
American participants (see Table II. 4). Native American students left Upward Bound at about half the 
rate of African Americans. None of the other background factors appear to influence persistence. The 
project director’s rating, which indicates how likely students were to be selected for Upward Bound 
using normal selection procedures, is also uncorrelated with persistence. 



C. RANGE AND INTENSITY OF UPWARD BOUND SERVICES RECEIVED BY 
PARTICIPANTS 



• The typical number of academic and nonacademic sessions attended each year was 274. 
Two-thirds of these sessions occurred during the summer and the rest took place during 
the academic year. 

• The principal academic activities were instruction in math and English. 

• Among nonacademic activities, most students participated in college preparation 
sessions, counseling sessions, and skill development activities. Counseling generally 
focused on personal, academic, career, and group-dynamic-related issues. 



During the summer of 1994, we asked Upward Bound project directors to report about the 
academic and nonacademic services students had received since entering the program. Reports of 
participation show an intense program that includes both academic and nonacademic activities (see 
Tables n.5 and II. 6). 8 Overall, we found students were most likely to attend English and math courses, 



8 Analyses reported in Tables 1H.5-III.7 are based on only those participants who had an 
opportunity to participate in at least one Upward Bound academic year program and one summer 
program. Students in this group were randomly selected for Upward Bound before August 1, 1993. 



TABLE E.4 



ADJUSTED RELATIVE RATES OF LEAVING UPWARD BOUND 



Background Factor 


Relative Rate of Leaving 
Upward Bound 


Female 8 


.60 


Hispanic b 


.86 


Asian b 


.35** 


White b 


.78 


Native American 1 ” 


.52* 


Other race b 


.81 


Grade level 8 


1.15 


Low income/first generation 8 


1.09 


Upward Bound project director’s rating 


1.01 


Worked for pay during summer 


1.19 


Plans to complete at least a college degree 


73** 



* Statistically significant at the .10 level. 

** Statistically significant at the .05 level. 

“Reference group is male. 
b Reference group is African American. 

“Coded as grade 8, 9, 10, 11, and 12. 

d Reference group is low income only and first generation only. 
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TABLE E.5 



STUDENT PARTICIPATION IN UPWARD BOUND ACADEMIC COURSES 
AND NONACADEMIC ACTIVITIES DURING SUMMER 1993 



Typical Number of Sessions Attended 3 



Percentage Enrolled 


All Students 1 * 


Enrolled Students 1 * 


All courses: 


99 


100 


100 


English 


87 


27 


30 


ESL 


0 


0 


24 


Foreign languages 


19 


0 


24 


Math 


96 


24 


24 


Computers 


23 


0 


27 


Science 


69 


20 


24 


Social science 


13 


0 


24 


Elective 


74 


20 


22 


Other 


8 


0 


24 


All activities: 


100 


83 


83 


College preparation 


92 


13 


19 


Career exploration 


43 


0 


3 


Self-awareness 


63 


1 


3 


Field trips 


90 


4 


5 


Cultural awareness 


51 


1 


2 


Counseling 


93 


18 


20 


Skill development 


85 


24 


25 


Other 


7 


0 


1 



3 “Typical” refers to the median number of sessions attended. 

b “All students” refers to all Upward Bound participants regardless of whether they actually enrolled 
in a course. “Enrolled students” refers to only those who were actually enrolled. 



TABLE H.6 



STUDENT PARTICIPATION IN UPWARD BOUND ACADEMIC COURSES 
AND NONACADEMIC ACTIVITIES DURING THE 1993-94 ACADEMIC YEAR 



Typical Number of Sessions Attended 3 



Percentage Enrolled All Students 11 Enrolled Students 11 



All courses: 


70 


39 


64 


English 


65 


14 


20 


ESL 


0 


0 


16 


Foreign languages 


4 


0 


16 


Math 


58 


6 


20 


Computers 


6 


0 


23 


Science 


40 


0 


20 


Social science 


6 


0 


14 


Elective 


40 


0 


20 


Other 


3 


0 


7 


All activities: 


100 


51 


51 


College prep 


90 


8 


10 


Career exploration 


18 


0 


1 


Self-awareness 


61 


1 


. 3 


Field trips 


71 


2 


3 


Cultural awareness 


57 


1 


2 


Counseling 


95 


12 


12 


Skill development 


89 


16 


20 


Other 


5 


0 


1 



3 “Typical” refers to the median number of sessions attended. 

b “All students” refers to all Upward Bound participants regardless of whether they actually enrolled 
in a course. “Enrolled students” refers to only those who were actually enrolled. 
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and that the typical number of sessions attended during a year was 274. 9 About two-thirds of the 
sessions took place during the summer, and the remainder were taken during the academic year. 

The principal academic activities in Upward Bound summer programs include instruction in 
English, math, and science. For example, almost all students in the summer program took at least one 
math course, more than three-quarters took an English course, and almost three-quarters took a science 
course. Fewer than one-quarter took a foreign language, computer science, or social science course. 
Generally, students who enrolled in a course attended about 24 sessions in each subject area during 
the summer. For English, enrolled students attended about 30 sessions. 

Participation was also high in nonacademic activities. More than three-quarters of the students 
participated in college preparation, counseling, and skill development activities (that is, tutoring and 
development of study skills). The typical participant attended 1 9 to 25 sessions, and most students 
participated in at least one field trip. The most common topics covered in the counseling sessions 
included personal, academic, career, and group dynamic-related issues (see Table H7). Family 
counseling and financial aid counseling were reported for only a few students; this may reflect the 
young age of the participants and may become more prevalent as they progress through high school. 
Looking across all service areas, we found that during the summer the typical participant attended 
about 100 academic sessions and 83 nonacademic sessions. 

During the academic year between two-thirds and three-quarters of the students took an academic 
course and students attended fewer sessions than during the summer (about 39 sessions). Students 
most often took courses in English and math. There was no other subject area in which the majority 



9 “Typical” refers to the median number of sessions. For example, if the median number of 
sessions attended is 274, then this means 50 percent of the participants attended fewer than 274 
sessions and 50 percent attended more than 274 sessions. 
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TABLE H.7 



STUDENT PARTICIPATION IN UPWARD BOUND COUNSELING SERVICES 





Percentage Enrolled 


Typical Number of Sessions Attended 3 
All Students' 5 Enrolled Students' 5 


Summer 1993 


All counseling: 


93 


18 


20 


Personal 


63 


3 


4 


Family 


13 


0 


3 


Academic advising 


56 


1 


3 


Financial aid 


19 


0 


5 


Career 


57 


1 


2 


Group dynamics 


62 


5 


10 


Academic year 1993-94 


All counseling: 


95 


12 


12 


Personal 


63 


2 


5 


Family 


16 


0 


2 


Academic advising 


63 


2 


3 


Financial aid 


22 


0 


2 


Career 


54 


1 


2 


Group dynamics 


54 


1 


14 



“’’Typical” refers to the median number of sessions attended. 

b ”All students” refers to all Upward Bound participants regardless of whether they actually enrolled 
in a course. “Enrolled students” refers to only those who were actually enrolled. 
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of students took a course. Within individual subject areas, enrolled students generally participated 
in between 1 5 and 20 sessions. As with the summer program, more than three-quarters of all students 
took part in college preparatory, counseling, and skills development activities. The typical number 
of sessions attended in these nonacademic areas was 10-20 sessions. 

D. CONCLUSIONS 

This chapter examined students’ persistence in the Upward Bound program and the range of 
services students receive from the program. We found that one-fifth of the applicants offered slots 
chose not to participate. Some reasons given for not participating include employment-related 
considerations, transportation problems, and family issues. Only two student background 
characteristics were correlated with participation: (1) students’ race/ethnic background and (2) grade 
level when applying for Upward Bound. We found that Hispanic and Asian students relative to 
African American students and younger students relative to older students were more likely to 
participate if offered a program slot. 

Looking at program persistence, we learned that almost 40 percent of the participants will leave 
the program within 1 2 months. The most common reason students gave for leaving the program was 
to take a job. Background factors correlated with leaving the program include students’ race/ethnic 
background and their educational plans before entering Upward Bound: Asian and Native American 
participants in contrast to African American participants and participants who expected to complete 
at least a four-year college degree were the most likely to persist. 
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III. SHORT-TERM IMPACTS OF UPWARD BOUND 



Upward Bound’s goals include increasing participants’ skills and motivation so that they may 
succeed in education beyond high school. The program’s ability to meet these goals can be assessed 
by examining many outcomes. Some outcomes that we explore include students’ attitudes and 
educational expectations, course taking and grades, in-school behavior, and parents’ involvement in 
education-related activities. Outcomes such as high school completion and college attendance and 
persistence must wait until the second follow-up report in late 1997 when students in the sample are 
old enough to have made these transitions. 1 We begin this chapter by presenting a context for 
interpreting the findings and the overall impacts for Upward Bound. Next, we describe the program 
impacts for all applicants and all participants and for specific subgroups of students. 

A. A CONTEXT FOR INTERPRETING PROGRAM IMPACTS 

We must consider several contextual factors when interpreting the impact of Upward Bound: (1 ) 
students’ grade in school when they applied, (2) average exposure to the program, and (3) differences 
between Upward Bound applicants and members of the control group in the academic instruction and 
counseling they received from other programs or high schools. 



• Most applicants were high school freshman or sophomores. Three-quarters of the 
students applying for Upward Bound in this evaluation had just completed grades 8 or 
9. Moreover, the average time between application and the first follow-up data 
collection was about 12 months. This means the analyses conducted for this report 
capture students’ high school experiences during their freshman or sophomore year. 



'Only 30 students in our sample dropped out of high school between the baseline survey and the 
end of the 1994 school year. Weighting the data to reflect the sample design, we find that about one 
percent of the control group dropped out of high school and about two percent of the treatment group 
dropped out of school. In large part this low dropout rate may reflect the young age of students who 
were recruited by the Upward Bound projects. Given the small number of dropouts at this point we 
chose not to analyze this outcome. 
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• Students had a limited amount of exposure to Upward Bound. We know from the 
findings presented in Chapter II that about 20 percent of those randomly selected for 
Upward Bound chose not to participate and almost 40 percent of the participants had left 
Upward Bound during the first 1 2 months. These facts taken together tell us that about 
50 percent of the participants received no more than 8 months of exposure to Upward 
Bound services. 

• Many students in the control group received some instruction or other services. More 
than 40 percent of the control group received some tutoring, counseling, or participated 
in academic workshops during the school year, and more than 1 0 percent of the control 
group received services during the summer. Anecdotal evidence from Upward Bound 
project directors suggests, for example, that some members of the control group 
participated in the federally funded Talent Search program. However, the services 
received by members of the control group are probably much less intense than those 
offered through Upward Bound. Also, while 40 percent of the control group received 
some limited set of services, 60 percent appear to have received no supplemental 
services. 



B. THE AVERAGE IMPACT OF UPWARD BOUND 



• Participants and parents of participants had higher educational expectations than 
members of the control group. 

• Participants earn more academic credits during high school, particularly in English, 
social studies, and science. Impacts related to credits are in part a product of some 
high schools offering credits for completing courses offered through the Upward 
Bound program, and in part a product of students earning additional credits for 
completing high school courses. 

• Participants who have been in Upward Bound for a longer period earn more credits 
in high school than other participants. 

• Students most likely to benefit from Upward Bound include Hispanic students and 
students with low initial educational expectations. 

• Other student-related outcomes such as grade point average, attitudes, parental 
involvement, and students’ behavior in school were not affected by participation in 
Upward Bound. 



The central question we address in this chapter is: On average, how do the educational outcomes 
of Upward Bound applicants and participants compare with what they would have achieved without 
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